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O ■ Abstract 

(N 

Quantum computers are susceptible to noises from the outside world. We investigate the 

effect of perturbation on the hitting time of a quantum walk and the stationary distribution 

prepared by a quantum walk based algorithm. The perturbation comes from quantizing a 

transition matrix Q with perturbation E (errors). We bound the perturbed quantum walk 

hitting time from above by applying Szegedy's work and the perturbation bounds with Weyl's 

<— j i perturbation theorem on classical matrix. Based on an efficient quantum sample preparation 

CV approach invented in speed-up via quantum sampling and the perturbation bounds for stationary 

distribution for classical matrix, we find an upper bound for the total variation distance between 

the prepared quantum sample and the true quantum sample. 
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1 Introduction 

Markov chains and random walks have been useful tools in classical computation. One can use 
l/^ | random walks to obtain the final stationary distribution of a Markov chain to sample from. In such 

an application the time the Markov chain takes to converge, i.e., convergence time, is of interest 
because shorter convergence time means lower cost in generating a sample. Sampling from station- 
ary distributions of Markov chains combined with simulated annealing is the core of many clever 
(^ ■ classical approximation algorithms. For instance, approximating the volume of convex bodies [T], 

approximating the permanent of a non-negative matrix [2], and the partition function of statistical 
physics models such as the Ising model [3] and the Potts model [3J. In addition, one can also use 
the random walks to search for the marked state in the Markov chain, in which the hitting time is 
S^ . of interest. It is because hitting time indicates the time it requires to find the marked state. 

a' 

The Markov Chain Monte Carlo (MCMC) method is a centerpiece of many efficient classical 
algorithms. It allows us to approximately sample from a particular distribution ir over a large state 
space f2. Perturbations of classical Markov chains are widely studied with respect to hitting time 
and stationary distribution. The variation of a stationary distributuion caused by perturbation 
would deteriorate the accuracy of our sampling. With the above facts, we are interested to know 
what effect perturbation has on currently existing quantum walk based algorithms. 

The note is organized as follows. In section [2TT1 we present the deviation effect of perturbation 
on spectral gap of Markov chain and we apply it to the hitting time of a quantum walk in section 
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12.21 In section [2T3l we state the result of total variation distance of classical stationary distributions. 
By using an efficient algorithm [5] for preparing quantum samples, in section l2~4l we obtain the total 
variation distance between the prepared quantum sample and the true quantum sample. Finally 
in section El we make our conclusion and suggest future works. 

2 The Perturbation 

Given a stochastic symmetric matrix P € C nxn , we can quantize the Markov chain [6] and we 
showed that the implementation of one step of quantum walk [7] can be achieved efficiently. How- 
ever, the above settings always are under the assumption of perfect scenarios. In real life there are 
many sources of errors that would perturb the process. Noises might be propagated along with the 
input source or they might be introduced during the process. Here we solely look at the noises that 
are introduced at the beginning of the process. 

The noises can be introduced due to the precision limitation and the noisy environment. For 
instance, not all numbers have a perfect binary representation and the approximated numbers 
would cause perturbation. Suppose our input decoding mechanism can always take the input ma- 
trix and represent it in a symmetric transition matrix Q where Q can be perfectly represented by 
the limited precision and it is the matrix closes to the original matrix P that the system can prepare. 

Let E be the noise that is introduced because of system's precision limitation and the environ- 
ment, we can express the transistion matrix as 

Q = P + E. (1) 

2.1 Classical Spectral Gap Perturbation 

Classically many researches [H EJ [101 [HI El [13] are focused on the spectral gaps and stationary 
distributions of the matrice with perturbation. In a recent work by Ipsen and Nadler [8] , they 
refined the perturbation bounds for eigenvalues of Hermitians. Throughout the rest of the note, 
|| • || always denotes li norm, unless otherwise specified. Based on their result, we summarized the 
following: 

Corollary 1. Suppose P and Q G c nxn are Hermitian symmetric transition matrices with respec- 
tive eigenvalues 

A n (P) < • • • < Ai(P) = 1, An(Q)<...<Ai(Q) = l, (2) 

and Q = P + E, then 

max \Xi(P) - Xi(Q)\ < \\E\\. (3) 

l<i<n 

Furthermore, the spectral gap 5 of P and the spectral gap A of Q have the following relationship 

S- \\E\\ < A <<y+||.E||. (4) 

Proof. Eq. ([3]) is a direct result from the Weyl's Perturbation Theorem. The Weyl's Perturba- 
tion Theorem bounds the worst-case absolute error between the ith. exact and the ith. perturbed 
eigenvalues of Hermitian matrices in terms of the I2 norm [1Q|, [TT] . And since 

1 _ A 2 (P) = 5, 1 - A 2 (Q) = A, (5) 



by eq. (J3j) we have \5 — A| < ||-E||. Therefore, in general we can bound the perturbed spectral gap 

A as 

5 - \\E\\ < A < 5 + \\E\\. (6) 

□ 
Generally speaking, the global norm of E might be very large when the dimensions n >> 1 
|14j . However, in our case because E is the difference between two very close stochastic symmetric 
matrices, its global norm would never become large. 

2.2 Quantum Hitting Time Perturbation 

Given two Hermitian stochastic matrices, P and Q, we explore the difference between walk oper- 
ators, W(P) and W(Q), with respect to their hitting time. Denote the set of marked elements as 
\M\. Based on the result from Corollary \J\ we have the following: 

Corollary 2. Given two symmetric reversible ergodic transition matrices P and Q € C nxn , where 
Q = P + E, let W(P) and W(Q) be quantum walks based on P and Q, respectively. Let M be 
the set of marked elements in the state space. Denote HT{P) the hitting time of walk W(P) and 
HT(Q) the hitting time of walk W(Q). Suppose \M\ = eN . If the second largest eigenvalues of P 
and Q are at most 1 — 5 and 1 — A, respectively, then in general 



where S - \\E\\ < A < 5 + ||£||. 

Proof. Suppose the Markov chain P, Q and matrix E are in the following block structure 

'-(2 2)- «-(££)■ *-(5 2) 

where we order the elements such that the marked ones come last, i.e., P4, Q4 and E4 G C|jw| x |jv/|- 
The corresponding modified Markov chains [6] would be 

«-(S!)-(S:S!)- 



By [6], we have HT(P) = 0( a /t^t7^) and HT(Q) = OL LL » ). Since we know 



ll^ill<l-y and ||Qi|| < 1 - ^ (10) 

by [6] and by Cauchy's interlacing theorem we have \\E\\ > \\E\\\ |15^ Cor. III. 1.5], we then obtain 

||Q 1 ||<min{||P 1 || + 11^11,1 _(^M£} (11) 

as 5 — \\E\\ < A < 5 + \\E\\. Therefore, the hitting times for P and Q are derived. □ 



2.3 Classical Sample Perturbation 

In this section we adapt the results from the work [9] to bound the stationary distriubtion tt(Q) 
of a perturbed matrix Q with respect to the perturbation E and the true stationary distribution 
tt(P), i.e., 

Q • tt(Q) = tt(Q), P-7r(P)=7r(P). (12) 

Let Q, be the state space and 0' = il U {0}. The total variation distance between two probability 
distributions over £1 is defined as 

D(n(P),n(Q)) = \ £ || ff (P) x - Tr^i = max |tt(P) 5 - tt(Q)s|. (13) 

Here 7r(P) denotes the stationary distribution of matrix P, ir(P) x is the xth element of vr(P) and 
7r(P)s denotes the sum of tt(P) x where x £ S, i.e., ^2 xG s^(P)x = n(P)s- 

In [9] it is assumed that the transition matrix is row-wise stochastic. Our matrix is column-wise 
stochastic (see eqn. (|12|) ) but since it is symmetric, it is also row-stochastic. By chooseing condition 
number k§ in [9] , the ergodicity coefficient, using the l p norm, is defined as 



lip 
\\v\\ v =l,v T e=0 



t p (P)= sup ||^ T P|| p (14) 



where e is a column vector of all ones. Since P is a stochastic matrix, the ergodic coefficient 
satisfies < Ti(P) < 1. In case of T\[P) < 1, we have a perturbation bound in terms of the ergodic 
coefficient of P: 

d(-k(p)MQ)) = \\\<p) - *(Q)h < 2(1 _ 1 (tiP)) I1^IU- (is) 

2.4 Quantum Sample Perturbation 

While there are several methods that make use of Szegedy's quantum walk operators to prepare 
quantum samples [5j [To] [T7] , we choose [5] as the main approach to analyze as it leads to an overall 
speed-up in the general case. The other approaches [TBI E] t & ke advantage of the quantum Zeno 
effect but the problem is that the quantum Zeno effect would result in an exponential slow-down 
in the general case. 

The work by Wocjan and Abeyesinghe [5] showed an approach to prepare the coherent stationary 
distribution of a Markov Chain via modified quantum walk and Grover's ^-amplitude amplication 
techniques. The theorem listed below is the main theorem in Speed-up via Quantum Sampling. We 
refer the interested readers to [5] for details on this algorithm for the construction techniques and 
the computational complexity. 

Theorem 1 (Speed-up via quantum sampling [5]). Let Qo, Q\, . . . ., Q r = Q be a sequence of clas- 
sical Markov chains with stationary distributions ttq, 7Ti, . . . , ir r and spectral gap 5q, . . . , 5 r . Assume 
that the stationary distributuions of adjacent Markov chains are close to each other in the sense 
that |(-7rj|7Tj + i)| 2 > c where c is some constant, for i = 0, . . . ,r — 1.. Then for any rj > 0, there 
is an efficient quantum sampling algorithm, making it possible to sample according to a probability 
distributuion jr r that is close to ir r with respect to the total variation distance, i.e., D(% ri it r ) < rj. 



Based on the theorem above, we can immediately conclude the following corollary: 

Corollary 3. When the coherent quantum sample based on the perturbed Markov chain is prepared 
by using techniques of J2^ with precision n, the total variation distance between the prepared quantum 
sample fr(Q) and the true quantum sample ir(P) is less than r\ + 2 (i-< T p)\ ll-^lloo- 

Proof. By Theorem U\ we can efficiently construct a quantum sample vr(Q) r that is n close to tt(Q). 
Then by triangle inequality we obtain 

D(tt(P), vf (Q)) < D(tt(P),tt(Q)) + D(tt(Q) + ff (Q)) < 2(1 _ 1 (riP)) 11^11°° + V- (16) 

□ 

3 Conclusion and Discussion 

We apply the existing classical results from matrix perturbation to quantum walk based algorithms. 
With the noise introduced at the input, as quantum system is susceptible to the outside world and 
some other precision limitation problem, we bounded the quantum hitting time with perturbation 
from the above that the perturbed quantum walk hitting time is 




HT(Q) = 0[ K l - s ^ ||)g ). (17) 

In the meanwhile, we also showed that how the quantum sample prepared by using the approach 
in [5] would fluctuate from the true quantum sample when perturbation is present. The analysis is 
based on the assumption that we have a series of Markov chains Ql, . . . ,Q r = Q. Hence, we have 

D(tt(P), tt(Q)) < _\ TlP)) Halloo + V- (18) 

Intuitively from the analysis we can see that the total variation distance for D(tt(Q),tt(Q)) 
is simply additive and D(ir(P),ir(Q)) cannot be eliminated. However, if the matrix P = Qi is 
inside the sequence Qi,...,Q r where 1 < i < r, can we invent a procedure to detect to avoid such 
overshoot? Future study is to find the relation between quantum mixing time, the time it takes 
to get 77-close to the true stationary distribution, and the quantum hitting time as it was studied 
so classically. Furthermore, another possible analysis approach would be assuming that we have a 
series of Markov chains P\ , . . . , P r = P (without the noise) . We can adapt the analysis in [5] to 
study how the noise would affect (i) accuracy when blindly preparing the quantum sample without 
acknowledging the existence of noise or (ii) complexity when the noise is acknowledged and desired 
accuracy must be achieved. 
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